Generating effective test suites for model transformations using classifying terms
نویسندگان
چکیده
Generating sample models for testing a model transformation is no easy task. This paper explores the use of classifying terms and stratified sampling for developing richer test cases for model transformations. Classifying terms are used to define the equivalence classes that characterize the relevant subgroups for the test cases. From each equivalence class of object models, several representative models are chosen depending on the required sample size. We compare our results with test suites developed using random sampling, and conclude that by using an ordered and stratified approach the coverage and effectiveness of the test suite can be significantly improved.
منابع مشابه
Automated Generation of Test Suites for Error Analysis of Concept Recognition Systems
We present an architecture and implementation of a system that builds structured test suites for concept recognition systems. The system applies provided test case definitions to a target concept vocabulary, to generate test cases organised according to those definitions. Test case definitions capture particular characteristics, or produce regular transformations, of concept terms. The test sui...
متن کاملGenerating Effective Test Suites by Combining Coverage Criteria
A number of criteria have been proposed to judge test suite adequacy. While search-based test generation has improved greatly at criteria coverage, the produced suites are still often ineffective at detecting faults. Efficacy may be limited by the single-minded application of one criterion at a time when generating suites—a sharp contrast to human testers, who simultaneously explore multiple te...
متن کاملCERIAS Tech Report 2006-24 SCALABLE AND EFFECTIVE TEST GENERATION FOR ACCESS CONTROL SYSTEMS THAT EMPLOY RBAC POLICIES
Conformance testing procedures for generating tests from the finite state model representation of Role Based Access Control (RBAC) policies are proposed and evaluated. A test suite generated using one of these procedures has excellent fault detection ability but is astronomically large. Two approaches to reduce the size of the generated test suite were investigated. One is based on a set of six...
متن کاملUCM-Based Generation of Test Goals
The Use Case Map (UCM) scenario notation can be used to model service requirements and high-level designs for reactive and distributed systems. It is then a natural candidate for use in the process of generating requirement-directed test suites. We survey several approaches for deriving test goals from UCM models. We distinguish three main approaches. The first approach is based on testing patt...
متن کاملA probabilistic alternative to regression suites
Automated regression suites are essential in developing large applications, while maintaining reasonable quality and timetables. Themain argument against the automation of regression suites, in addition to the cost of creation and maintenance, is the observation that if you run the same test many times, it becomes increasingly less likely to find bugs. To alleviate such problems, a new regressi...
متن کامل